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Literacy skills are critical to students’ academic achievement 
and for setting them on a path to successful high school 
graduation and readiness for college and careers. Xtreme 
Reading is a supplemental literacy curriculum designed to 
improve the literacy skills of struggling students in grades 
6 to 12. The curriculum is primarily designed to help 
students improve their vocabulary, decoding, fluency, 

and reading comprehension skills. To ensure a productive 
learning environment, students initially learn social skills 
associated with creating a supportive learning community, 
including how to participate in certain class activities (for 
example, whole-group discussion, small-group work, 
partner work, transitions). They also participate in a 
motivational program whereby they discuss their hopes 


and dreams for the future and set personal goals related to 
reading and other life areas. The Xtreme Reading program 
includes teacher-led whole-group instruction, cooperative 
group work, paired practice, and independent practice.! 


This What Works Clearinghouse (WWC) intervention 

report, part of the WWC’s Adolescent Literacy topic area, 
explores the effects of Xtreme Reading on student literacy 
achievement and comprehension (including reading 
comprehension and vocabulary skills). The WWC identified 
four studies of Xtreme Reading, two of which meet WWC 
standards. The evidence presented in this report is from 
studies of the effects of Xtreme Reading on ninth-grade 
students—including 81% non-White and 19% White students— 
from largely urban and diverse school districts. 


What Happens When Students Participate in Xtreme Reading?” 


The evidence indicates that implementing Xtreme Reading 
has no discernible effects on comprehension or general 
literacy achievement. 


Findings on Xtreme Reading from two studies that meet 
WWC standards are shown in Table 1. The table reports an 
effectiveness rating, an improvement index, and the number 
of studies and students that contributed to the findings. The 
effectiveness rating is based on the quality of the designs 
used in studies, whether the findings are favorable or unfa- 
vorable for the intervention, and the number of studies that 
tested the intervention. See Box 1 for more information on 
interpreting effectiveness ratings. 


In order to help readers judge the practical importance of 
an intervention’s effect, the WWC translates findings across 


studies into an “improvement index” by averaging findings 
that meet WWC standards within the same outcome domain. 
The improvement index can be interpreted as the expected 
change in percentile rank for an average comparison group 
student if that student had received the intervention. For 
example, an improvement index of +2 means that the 
expected percentile rank of the average comparison group 
student would increase by 2 points if the student received 
the Xtreme Reading program. A positive improvement index 
does not necessarily mean the estimated effect is statistically 
significant. Results for each individual outcome measure 
within domains are shown in Table 4. 


The evidence presented in this report is based on available 
research. Findings and conclusions could change as new 
research becomes available. 


Table 1. Summary of findings on Xtreme Reading from studies that meet WWC standards 


Outcome domain 


Comprehension 


Study Findings 


Evidence meeting WWC standards (version 4.0) 


Improvement index 


General literacy achievement 


Effectiveness rating (percentile points) Number of studies Number of students 
No discernible effects +2 1 2,329 
No discernible effects 0 2 1,870 


Note: For more information about outcome measures, see study descriptions in Tables 6 and 8. The effects of Xtreme Reading are not known for other outcomes within the 
Adolescent Literacy topic area, including alphabetics, reading fluency, writing conventions, writing productivity, and writing quality. 


BOX 1. HOW THE WWC REVIEWS AND DESCRIBES EVIDENCE 


The WWC evaluates evidence based on the quality and results of reviewed studies. The criteria the WWC uses for evaluating 
evidence are defined in the Procedures and Standards Handbooks and the Review Protocols. The studies summarized in this report 
were reviewed under WWC Standards (version 4.0) and the Adolescent Literacy topic area protocol (version 4.0). 


To determine the effectiveness rating, the WWC considers what methods each study used, the direction of the effects, and the 
number of studies that tested the intervention. The higher the effectiveness rating, the more certain the WWC is about the reported 
results and about what will happen if the same intervention is implemented again. The following key explains the relationship between 
effectiveness ratings and the statements used in this report: 


Effectiveness Rating Rating interpretation Description of the evidence 


Positive (or negative) effects The intervention is likely to change an Strong evidence of a positive (or negative) 
outcome effect, with no overriding contrary evidence 


Potentially positive (or negative) effects The intervention may change an outcome Evidence of a positive (or negative) effect with 
no overriding contrary evidence 


No discernible effects The intervention may result in little to no No affirmative evidence of effects 
change in an outcome 


Mixed effects The intervention has inconsistent effects Evidence includes studies in at least two of 
on an outcome these categories: studies with positive effects, 
studies with negative effects, or more studies 
with indeterminate effects than with positive or 
negative effects 


How is Xtreme Reading Implemented? 


The following section provides details of how districts 
and schools can implement Xtreme Reading. This 
information can help educators identify the requirements 
for implementing Xtreme Reading and determine whether 
implementing this intervention would be feasible in 

their districts or schools. Information on Xtreme Reading 
presented in this section comes from the developer’s 
website and studies that meet WWC standards (Kemple et 
al., 2008; Sprague et al., 2012). 


Comparison condition: The two studies of Xtreme 
Reading that contribute to this intervention report 
included three distinct comparison groups. Two of 
these were business-as-usual comparison groups 

in which students did not receive supplemental 


literacy instruction. They participated in a regularly 
scheduled elective class, such as band or art, instead 
of the Xtreme Reading class. In the third comparison 
group, students received the READ 180® curriculum as 


¢ Goal: The main goal of Xtreme Reading is to help students supplemental literacy instruction instead of a regularly 
improve their vocabulary decoding, fluency, and reading scheduled elective class. 
comprehension skills such that they can succeed in 
their general secondary education courses. The bulk 12 to 15 students. The assigned teacher, ideally an English 
of the program focuses on reading comprehension. In language arts teacher, reading teacher, special education 
order to ensure that students are productive learners, teacher, social studies teacher, or other interested 
they are also taught basic social skills for participating in intervention teacher, explicitly teaches literacy strategies 
class appropriately and they set personal goals for their and social skills using a prescriptive instructional 
learning in the school year. approach that includes step-by-step instructional 

¢ Target population: The program is designed for materials and daily plans. 
struggling readers in grades 6 to 12 whose reading skills * Frequency and duration of service: The Xtreme Reading 
are 2 or more years below grade level. Students must be program is designed to be delivered daily in a 45-minute 
reading at least at the fourth-grade level. class period. It can be adapted to a 90-minute schedule. 

* Method of delivery: Xtreme Reading is a supplemental e Intervention components: Xtreme Reading includes 
curriculum that is typically offered in addition to students several key components and features including instruction 
regular literacy instruction. In most schools, it replaces in advanced literacy strategies and social skills. Key 
an elective class. The program is designed for a class of components and features are described in Table 2. 


Table 2. Components of Xtreme Reading 


Key component 


Description 


Instruction in literacy 
strategies 


Instruction in social 
skills 


Instructional 
procedures 


Curriculum materials 


Teacher training 


The Xtreme Reading program includes instruction in advanced decoding skills, fluency, vocabulary, and reading comprehension 
using a number of instructional strategies. The Word Identification Strategy, which focuses on decoding, encompasses a variety 
of approaches to decode multi-syllable words, especially words that students encounter in secondary textbooks. Fluency 
instruction initially takes place in coordination with the Word Identification strategy and continues through the year. The Word 
Mapping strategy, which is focused on vocabulary, is aimed at teaching students new ways to determine and remember the 
meaning of the words and word parts (morphemes). Four strategies—Self-Questioning, Paraphrasing, Inferencing, and Visual 
Imagery—focus on reading and listening comprehension. The Self-Questioning Strategy enables students to ask themselves 
questions while reading, make predictions, and talk about answers to their questions. The Paraphrasing Strategy enables 
students to find and state the main idea and details for each paragraph as they read. The Inference Strategy enables students to 
analyze questions associated with a passage. When a question requires them to make an inference about information that is not 
in the passage, they look for clues and create an answer based on those clues. The Visual Imagery Strategy enables students to 
create pictures in their minds of the people, setting, and events described in a reading passage. 


The Xtreme Reading program includes explicit instruction in social skills to create and maintain a positive learning community 
within the classroom. In a program component called Xpect to Achieve, the teacher explains expected behaviors in a variety 
of classroom activities (discussions, paired work, small-group work, independent work), and teaches two units (Talking 
Together and the SCORE Skills) to ensure students acquire the needed social skills for Xtreme Reading activities. Then, while 
working through the Possible Selves unit, students identify their hopes, expectations, and fears as well as create and work 
toward goals related to reading and other life areas. 


Teachers are trained to implement highly structured methods to support the learning strategies. Control is incrementally 
relinquished to students as they progress through the following eight stages: description, modeling, verbal practice, guided 
practice, paired practice, independent practice, differentiated instruction, and integration and generalization. The teacher 
starts by describing and modeling a strategy, then moves to shared work with the students providing verbal explanations and 
guidance. The teacher then shifts more responsibility to students through activities involving paired practice between students 
and independent practice. The seventh stage, differentiated instruction, offers additional support to students who struggle with 
the strategy, while providing others with varied opportunities for practice. By the eighth stage, integration and generalization, 
students work independently to gain an understanding of the application of the strategy within and outside the Xtreme 
Reading classroom. 


The Xtreme Reading curriculum kit includes (1) an instructor notebook for use in teaching the Xpect to Achieve component 
and each of the literacy strategies; (2) a set of multimedia materials for instructors, including materials to use for remote 
learning; (3) 15 student passages books for the decoding and comprehension strategies; and (4) 15 student workbooks. 
Atypical lesson consists of a combination of the following activities: (1) a short warm-up; (2) a whole-class lesson, in which 
the teacher describes or models a strategy, the students and teacher practice a strategy together, or both; (3) student 
practice, where students practice independently or in pairs while the teacher walks around the room and provides feedback; 
(4) word activities, where students learn and practice vocabulary strategies; (5) guided reading, where the teacher and 
students read a novel together; and (6) a short wrap-up, which includes a review of the day’s lesson and a preview of the next 
day's lesson. 


The Xtreme Reading professional development model typically includes initial training for teachers, ongoing in-class 
mentoring by coaches, and workshops on specific routines. Five days of workshops are recommended either in the summer 
or spread across the school year. Schools often plan 3 workshop days in the summer and 2 days during the remainder of the 
school year. Teachers are trained to implement highly structured methods to support the learning strategies. 


Teacher training differed slightly across the two studies included in this intervention report. In Kemple et al. (2008), teachers 
received 5 days of summer training, 2 days of booster training during the year, and three on-site coaching visits that lasted 
2 days each. In Sprague et al. (2012), teachers received 3 days of summer training in the first study year, and 2 days in the 
second study year; teachers also attended 4 to 5 full days of additional workshops during the year. 


What Does the Xtreme Reading Program Cost? 


This preliminary list of costs is not designed to be major resources needed to implement the Xtreme Reading 
exhaustive; rather, it provides educators an overview of the program. The program costs described in Table 3 are based 
on the information available as of June 2020. 


Table 3. Cost ingredients for Xtreme Reading 


Cost ingredients Description Source of funding 
Personnel Typically, this is a supplemental program taught by existing Schools provide time for teachers to participate in the training and 
teachers already employed in the school or district. to deliver the intervention. School districts typically cover the costs 


Example types of teachers who have successfully taught of Xtreme Reading. 
the program are English language arts teachers, reading 

teachers, special education teachers, and intervention 

teachers. The Xtreme Reading professional development 

model includes training for teachers and ongoing in-class 

mentoring by coaches. Five days of workshops are 

recommended during the year. Workshop costs typically 

are about $1,500 per day plus expenses for a certified 

professional developer. 


Facilities The intervention is typically implemented in the students’ — School districts or schools provide the classroom facilities. 
regular classrooms. 

Equipment and Acomplete kit for using the Xtreme Reading program in School districts usually purchase Xtreme Reading materials. 

materials one classroom, including one teacher and 15 students, Funding typically comes from curriculum budget, including 


costs $2,200. The kit includes (1) an instructor notebook —_ federal Title | accounts. 
for use in teaching the Xpect to Achieve component and 
each of the literacy strategies; (2) a set of multimedia 
materials for instructors, including materials to use for 
remote learning; (3) 15 student passages books for the 
decoding and comprehension strategies; and (4) 15 
student workbooks. If the course is being taught for more 
than one class period per day by the same teacher (which 
is recommended), schools will need 15 student workbooks 
for each class period, and this is an added cost. Additional 
student workbooks can be purchased for future years. 
Schools can purchase a digital PDF version of the 
workbook to use in a remote learning environment. The 
student workbooks are the only program materials that will 
need to be replaced every year. 


For More Information: 


About Xtreme Reading 
Jocelyn Washburn, The University of Kansas, Center for Research on Learning, 1122 West Campus Road 
Lawrence, KS 66045 


Email: simpd@ku.edu Web: https://sim.ku.edu/xtreme-reading. Phone: (785) 864-0626 
About the cost of the intervention 


Web: https://sim.ku.edu/xtreme-reading. 
All cost data were obtained from the program developer. 


Research Summary 


The WWC identified four studies that investigated the 
effectiveness of Xtreme Reading (Figure 1): 


¢ 2 studies meet WWC group design standards without 
reservations 


¢ 1study does not meet WWC group design standards 
¢ 1 study is ineligible for review 


The WWC reviews findings on the intervention’s effects on 
eligible outcome domains from studies that meet standards, 
either with or without reservations. Based on this review, 
the WWC generates an effectiveness rating, which summa- 
rizes how the intervention impacts, or changes, a particular 
outcome domain. The WWC reports additional supple- 
mental findings, such as those reported separately for each 


Figure 1. Effectiveness ratings for studies 


studies meet WWC Gens meet WWC 


standards without 
reservations 


standards with 
reservations 


Contribute to effectiveness ratings 


student cohort in Kemple et al. (2008), on the WWC website 
(https://whatworks.ed.gov). These supplemental findings 
and findings from studies that either do not meet WWC 
standards or are ineligible for review do not contribute to 
the effectiveness ratings. 


The two studies of Xtreme Reading that meet WWC group 
design standards reported findings on comprehension and 
general literacy achievement outcomes. No other findings 
in the studies meet WWC group design standards within any 
outcome domain included in the Adolescent Literacy topic 
area.* Citations for the three studies reviewed for this report 
are listed in the References section, which begins on page 11. 
A citation for the study that is ineligible for review and the 
reason the WWC determined it was ineligible are also listed 
in the References section 


study does not study is 


meet WWC 
standards 


ineligible for 
review 


Do not contribute to effectiveness ratings 


Xtreme Reading has no discernible effects on comprehension 


The WWC determined that one study that meets WWC group design standards without reservations shows indeterminate 
effects of Xtreme Reading on comprehension (Kemple et al., 2008). 


Xtreme Reading has no discernible effects on general literacy achievement 


The WWC determined that two studies that meet WWC group design standards without reservations show indeterminate 
effects of Xtreme Reading on general literacy achievement (Kemple et al., 2008; Sprague et al., 2012). 


Main Findings 


Table 4 shows the findings from the two studies of Xtreme 
Reading that meet WWC standards. The table includes WWC 
calculations of the performance of the intervention group 
relative to the comparison group in terms of the mean 
differences and effect size. The effect size is a standardized 
measure of the effect of an intervention on outcomes, repre- 
senting the average change expected for all individuals who 
are given the intervention (measured in standard deviations 
of the outcome measure). For the mean difference and effect 
size values, a positive number favors the intervention group 


and a negative number favors the comparison group. A 
positive or negative improvement index does not necessarily 
mean the estimated effect is statistically significant. 


Based on findings from one study that meets WWC standards 
and includes 2,329 students, the effectiveness rating for the 
comprehension domain is no discernible effects. Based on find- 
ings from two studies that meet WWC standards and include 
1,870 students, the effectiveness rating for the general literacy 
achievement domain is no discernible effects. 


Table 4. Findings by outcome domain from studies of Xtreme Reading that meet WWC standards 


Mean 
(standard deviation) WWC calculations 
Sample Intervention Comparison Mean Effect Improvement 
Measure (study) Study sample size group group difference _ size index p-value 
Group Reading Students in 2,329 90.20 89.70 0.50 0.06 +2 17 
Assessment grade 9 (10.40) (10.20) 
and Diagnostic 
Evaluation (GRADE): 
Comprehension 
subtest (Kemple et 
al., 2008)? 
GRADE: Vocabulary Students in 2,329 93.60 93.30 0.30 0.03 +1 52 
subtest (Kemple et grade 9 (10.50) (10.40) 
al., 2008)? 
Not 
Outcome average for comprehension (Kemple et al., 2008)* 0.04 +2 statistically 
significant 
State test scores, Students in 1,191 0.10 0.03 0.07 0.08 +3 12 
English language arts grade 9 (0.95) (0.92) 
(ELA; Kemple et al., 
2008) 
Not 
Outcome average for general literacy achievement (Kemple et al., 2008)* 0.08 +3 statistically 
significant 
Stanford Diagnostic Students in 454 21.95 24.14 -2.19 -0.16 6 .08 
Reading Test, fourth grade 9 (13.38) (13.37) 
edition (SDRT-4; (vs. Read 180°) 
Sprague et al., 2012)’ 
SDRT-4 (Sprague et Students in 448 21.95 21.75 0.20 0.02 +1 85 
al., 2012)? grade 9 (13.38) (13.38) 
(vs. business-as- 
usual) 
Not 
Outcome average for general literacy achievement (Sprague et al., 2012)? -0.07 3 statistically 
significant 
Outcome average for general literacy achievement across all studies 0.00 0 


Notes: Some statistics may not sum as expected due to rounding. 

For Kemple et al. (2008), the intervention and comparison group standard deviations were provided by authors in response to a WWC author query. This study is characterized 
as having an indeterminate effect on the comprehension domain because the WWC-calculated study average effect size is not statistically significant. The study is characterized 
as having an indeterminate effect on the general literacy achievement domain because the estimated effect is not statistically significant. 

> For Sprague et al. (2012), the WWC calculated the p-value for the Read 180° comparison because the authors did not compare Xtreme Reading to Read 180°. This study 

is characterized as having an indeterminate effect on the general literacy achievement domain because the WWC-calculated study average effect size is not statistically 
significant. For more information, please refer to the WWC Procedures Handbook, version 4.0, page 22. 


In What Context Was Xtreme Reading Studied? 


The following section provides information on the setting the context in which the studies of Xtreme Reading were 
of the two studies of Xtreme Reading that meet WWC conducted and determine whether the program might be 
standards, and a description of the participants in the suitable for their setting. 


research. This information can help educators understand 


WHERE THE STUDY WAS CONDUCTED 


2 studies, 3,008 students in at least 39 high schools in 12 districts in Georgia, 
Maryland, Massachusetts, Nebraska, New York, South Carolina, Texas, Utah, and Virginia. 


Race Ethnicity 


19% 34% 


White Black Other Non-Hispanic Hispanic 


Gender: 51% Female English Learners: 4% Free & Reduced-P rice 
49% Male Lunch: 54% 


G rades PK K L é 3 4 5 5 5 8 ) 1 
Grade 9 


Details of Each Study that Meets WWC Standards 


This section presents details for each study of Xtreme Opportunities Study: Early impact and implementation 
Reading that meets WWC standards. These details include findings (NCEE 2008-4015). Washington, DC: U.S. 

the full study reference, findings description, findings Department of Education, Institute of Education Sciences, 
summary, and description of study characteristics. A National Center for Education Evaluation and Regional 
summary of domain findings for each study is presented Assistance. Retrieved from https://eric.ed.gov/?id=ED499778 


below, followed by a description of the study characteristics. 
These study-level details include contextual information 
about the study setting, methods, sample, intervention 
group, comparison group, outcomes, and implementation 
details. For additional information, readers should refer to 
the original studies. 


Findings from Kemple et al. (2008) show evidence 

of indeterminate effects of Xtreme Reading in the 
comprehension and general literacy domains (Table 5). The 
findings and research details summarized for this study 
come from three related citations, including the primary 
study listed above. See the References section, which begins 
R h details for Kemple et al. (2008) on page 11, for a list of all related publications. 

Kemple, J. J., Corrin, W., Nelson, E., Salinger, T., Herrmann, 
S., & Drummond, K. (2008). The Enhanced Reading 


Table 5. Summary of findings from Kemple et al. (2008) 


Meets WWC Group Design Standards Without Reservations 


Study findings 
; Sample Average Improvement Statistically 
Outcome domain size effect size index significant 
Comprehension 2,329 students 0.04 +2 No 
General literacy achievement 1,191 students 0.08 +3 No 


Table 6. Description of study characteristics for Kemple et al. (2008) 


WWC evidence Meets WWC Group Design Standards Without Reservations. This is a randomized controlled trial with low attrition. For 
rating more information on how the WWC assigns study ratings, please see the WWC Procedures and Standards Handbooks 
(version 4.0) and WWC Standards Briefs, available on the WWC website. 


Setting The study was conducted in 10 school districts across nine states in the United States. 


Methods The study randomly assigned eligible ninth-grade students within 17 schools to receive Xtreme Reading or to the 
comparison group. To be eligible for the study, students had to have reading proficiencies 2 to 5 years below the ninth-grade 
level based on the Group Reading Assessment and Diagnostic Examination (GRADE). The study included two cohorts of 
ninth-grade students: Cohort 1 was formed in the 2005-06 school year and consisted of 965 students randomly assigned to 
the intervention group and 750 students randomly assigned to the comparison group. Cohort 2 was formed in the 2006-07 
school year and consisted of 963 students randomly assigned to the intervention group and 741 students randomly 
assigned to the comparison group. The sample loss after random assignment (attrition) was within the acceptable threshold 
for the review. At the individual level, the overall attrition rate ranged from 32% to 65% depending on the outcome measure, 
and differential attrition ranged from 0 and 3 percentage points. 


Study sample Across the 17 high schools and both student cohorts, the analytic sample for comprehension outcomes included 2,329 
ninth-grade students. The analytic sample for general literacy achievement included 1,191 of these students for whom 
scores on the English language arts state assessment were obtainable from school administrative records. 


Of the 2,329 students in the analytic sample for comprehension outcomes, 50% spoke another language besides English at home: 
44% were African American, 17% were White, 6% were another race, and 33% identified as Hispanic; and 51% were male. Similar 
information about the composition of the analytic sample for the general literacy achievement domain was not available. 


Intervention The Xtreme Reading program was implemented as a yearlong supplemental course in place of a ninth-grade elective class 

group and was offered in addition to students’ regular English language arts classes. The program was scheduled for a minimum 
of 225 minutes of classroom instruction per week via a 45-minute class every day or a 75- to 90-minute class meeting every 
other day. Within each participating high school, an experienced, full-time English language arts or social studies teacher 
volunteered and was subsequently trained to implement the Xtreme Reading program to both student cohorts in the study. 
This teacher then taught four Xtreme Reading classes with 12 to 15 students per class. 


Comparison Students in the comparison group received the standard English language arts instruction and continued their participation 
group in a regularly scheduled elective class, such as career and technical education, art, physical education, health, or foreign 
language. They did not receive supplemental English language arts instruction. 


Outcomes and Study authors reported findings on three outcome measures that are eligible for review under the Adolescent Literacy topic 

measurement area. Two of these outcome measures were reviewed within the comprehension domain: Comprehension and Vocabulary 
subtests of the GRADE. The third eligible outcome measure was based on each state’s end-of-year assessment in English 
language arts and was reviewed within the general literacy achievement domain. 


The two GRADE subtests were administered as baseline and follow-up assessments for both cohorts. All schools in both 
cohorts administered follow-up assessments at the end of the ninth grade. 


Students’ end-of-year test scores on the English language arts assessment were obtained from schools’ administrative 
records and linked to the students in the analytic sample. The content of the English language arts state assessments 
differed across the nine states. The study authors standardized and pooled English language arts scores across all 
participating districts. 


Findings for both outcome measures were reported as pooled findings across both cohorts (main findings) and separately 
by cohort (supplemental findings). Findings for other subgroups of interest were ineligible for review because the analytic 
samples included students in a different set of 17 schools who received Reading Apprenticeship® instead of Xtreme 
Reading and were included in the intervention group. In an author query, the WWC requested subgroup findings including 
only students in the 17 schools where Xtreme Reading was offered, but the authors did not provide these data to the WWC. 
Summaries of the reviewed supplemental findings are available on the WWC website (https://whatworks.ed.gov). The 
supplemental findings do not factor into the intervention’s rating of effectiveness. 


All other outcome measures the authors collected during the study were ineligible for review, including reading behavior 
measures created from student survey data; outcomes from a teacher survey; and a number of findings drawn from 
administrative data, including course grades, credit accumulation, attendance, and disciplinary infractions. 


Additional Within each high school assigned to Xtreme Reading, an experienced, full-time English language arts or social studies 
implementation teacher volunteered to teach the program to both student cohorts. For the first year of the study, the 17 Xtreme Reading 
details teachers received one 5-day summer training before the start of the study year, one 2-day booster training during the year, 


and three 2-day on-site coaching visits. Of the 17 teachers who volunteered to administer the Xtreme Reading program 

at the start of the first study year, seven were replaced by the end of the first year. For the second year of the study, newly 
recruited Xtreme Reading teachers attended a 2-day training immediately prior to a 3-day training for all Xtreme Reading 
teachers during the summer before the start of the 2006-07 school year. All Xtreme Reading teachers also received a 
2-day booster training and three 2-day on-site coaching visits during the second study year. No Xtreme Reading teachers 
were replaced during the second study year. In both study years, district coordinators were invited to observe the trainings 
to become familiar with the program in case they had to provide technical assistance or other support to Xtreme Reading 
teachers during the study period. 


Research details for Sprague et al. (2012) Findings from Sprague et al. (2012) show evidence of an 
Sprague, K., Zaller, C., Kite, A., & Hussar, K. (2012). indeterminate effect of Xtreme Reading in the general 


Springfield-Chicopee School Districts Striving Readers ery acne vemicne dora aa eapiei): 
(SR) Program final report years 1-5: Evaluation of 

implementation and impact. Providence, RI: The Education 

Alliance at Brown University. Retrieved from https://eric. 

ed.gov/?id=ED600926. 


Table 7. Summary of findings from Sprague et al. (2012) 


Meets WWC Group Design Standards Without Reservations 


Study findings 
; Sample Average Improvement Statistically 
Outcome domain size effect size index significant 


General literacy achievement 679 students -0.07 -3 No 


Table 8. Description of study characteristics for Sprague et al. (2012) 


WWC evidence 
rating 


Setting 


Methods 


Study sample 


Intervention 
condition 


Comparison 
condition 


Outcomes and 
measurement 


Additional 
implementation 
details 


Meets WWC Group Design Standards Without Reservations. This is a randomized controlled trial with low attrition. 


The study was conducted in five schools within two school districts, Chicopee and Springfield, in western Massachusetts. 


The study was conducted with five separate cohorts across 5 academic years. In each of the 5 study years, ninth-grade 
students in five study schools were screened for eligibility before random assignment. Students at least two—but less than 
four—grade levels behind in reading performance for their grade level were selected to participate in the study. Students 
were excluded from the sample if (1) they had an Individualized Education Program that specified reading supports not 
compatible with Xtreme Reading; (2) they lacked sufficient English language proficiency; (3) their parents opted them out 
of the study; (4) they were enrolled in an off-campus evening school; (5) they were deemed not to be a “struggling reader” 
based on grade history and past scores on the English language arts state test; or (6) they could not be located in school 
enrollment records. 


Across the 5 study years, the authors randomly assigned 1,661 eligible ninth-grade students from five schools to one of 
three conditions: 547 students were assigned to receive Xtreme Reading, 548 students were assigned to receive READ 
180°, and 566 students were assigned to a business-as-usual comparison condition. Students were randomly assigned 
within blocks depending on whether they were in special education, were English language learners, or neither. In each of 
the 5 study years, the study authors also randomly assigned one teacher in each of the five schools to each of the three 
conditions. The authors separately contrasted the literacy outcomes of students in the Xtreme Reading condition to those 
of students in the READ 180° and business-as-usual conditions. The sample loss after random assignment (attrition) 

was within the acceptable threshold for the review. At the student level, the overall attrition rate ranged from 59% to 60% 
depending on the study condition, and differential attrition was 1 percentage point for all study conditions. 


Across the 5 study years, the analytic samples for the three study conditions —Xtreme Reading, READ 180°, and business-as- 
usual condition—included 223, 231 and 225 ninth-grade students, respectively, with reading proficiencies 2 to 4 years below the 
ninth-grade level. 


Of the 679 students in the analytic sample, 73% were eligible for free or reduced-price lunch, 26% were White, and 20% were in 
special education. A small percentage (4%) of the students were English learners, and more than half (57%) were female. 


The Xtreme Reading program was offered to students as a supplement to their standard English language arts course. 
Class size was capped at 15 students, and the class was taught by the teacher randomly assigned to administer the Xtreme 
Reading program in each study school in each of the 5 study years. The class took place for 45 minutes per day, sometimes 
within a 90-minute block of English language arts courses. 


Students in the business-as-usual comparison condition received the standard English language arts instruction provided 
in the regular school curriculum and continued their participation in any regularly scheduled elective class, such as career 
and technical education, art, physical education, health, or foreign language. They did not receive supplemental English 
language arts instruction. 


Students in the READ 180° condition received the READ 180° curriculum as a supplement to the standard English 
language arts course. The class was taught by the teacher randomly assigned to administer the Read 180° curriculum in 
each study school in each of the 5 study years. The class took place for 90 minutes per day, paced to complete the Read 
180° curriculum over 125 to 145 school days. 


Study authors reported findings on one outcome measure eligible for review under the Adolescent Literacy topic area. The 
measure of general literacy achievement in this study was the Stanford Diagnostic Reading Test, fourth edition (SRDT-4). Students 
took the SDRT-4 assessment in the spring of each study year. Students’ eighth-grade test results from the Massachusetts 
Comprehensive Assessment System (MCAS) in English language arts were used as a baseline covariate in the analysis of 
the SDRT-4 outcomes. 


The study also used the MCAS to assess the combined impact of Xtreme Reading and READ 180° on student literacy. 
Because the finding was not disaggregated by literacy intervention condition, it is ineligible for the current review. 


The developers of the Xtreme Reading program trained teachers on learning strategies for students. The professional development 
model included initial training, ongoing in-class mentoring by developers, and workshops on specific routines. The professional 
development varied across study years. Teachers received 3 days of summer training in the first study year, which was shortened 
to 2 days in the second study year. Administrators held a 1-day summer meeting to support teachers in the first study year only. 
Developers also conducted monthly in-class mentoring with teachers during both study years. Teachers also attended 4 to 5 full 
days of additional workshops, depending on the study year. 
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Endnotes 


'The descriptive information for this intervention comes 
from the intervention website: https://sim.ku.edu/xtreme- 
reading. The What Works Clearinghouse (WWC) requests 
that developers review the intervention description 
sections for accuracy from their perspective. The WWC 
provided the developer with the intervention description 
in June 2020 and the WWC incorporated feedback from 
the developer. Further verification of the accuracy of the 
descriptive information for this intervention is beyond the 
scope of this review. 

?The literature search reflects documents publicly available 
by June 2020. Reviews of the studies in this report used 
the standards from the WWC Procedures and Standards 


Handbook (version 4.0) and the Adolescent Literacy review 


protocol (version 4.0). 


3 The effects of Xtreme Reading are not known for other 
outcome domains within the Adolescent Literacy topic 
area, including alphabetics, reading fluency, writing 
conventions, writing productivity, and writing quality. 
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